Method of displaying internet signal on tv

ABSTRACT

A TV-Internet Integration Box allows display of first data broadcast over a TV subscriber channel simultaneously together with second data broadcast over a digital data communications network has respective first and second inputs for receiving at a user premises the first data and the second data according to a user-profile associated with the second data. A combiner unit combines the first data and second data to form a combined video signal; and a video output coupled to the combiner unit conveys the combined video signal to a TV set in a user premises for displaying a first image corresponding to a first data and having a superimposed thereon a second image corresponding to the second data. A user at the user premises may interact with the second image for redirecting to the digital data communications network and displaying a program broadcast thereby is a least a portion of the TV set.

FIELD OF THE INVENTION

This invention relates to the broadcast of audio/video content over theTV infrastructure Internet.

BACKGROUND OF THE INVENTION

With the proliferation of cable TV and the high bandwidth currentlyavailable for the Internet, which promises to increase even more in thenear future, Internet TV is fast becoming a viable alternative toregular and cable TV broadcast channels. Moreover, Internet TV is notsubject to the government licensing laws required by cable and broadcastTV channels and thus offers programs that may not be obtainable usingregular and cable TV broadcast channels.

It is not uncommon for Internet broadcasters to offer near DVD-qualitymovies that can be viewed either using video streaming or downloaded tothe hard disk of a subscriber's computer for viewing “off-line”. Thevideo quality of such movies is vastly superior to that obtainable on aregular TV set, owing to the high resolution associated with computerdisplays that cannot presently be matched by TV screens. However, thisis not particularly troublesome where only pictures are displayed; butit becomes a problem when textual information is displayed that isformatted for high resolution computer monitors since the text is thenbarely legible when displayed on lower resolution TV screens. Thus, if aregular TV set is used to display Internet content that is rich in text,the resulting display quality is poor.

It would therefore be a significant benefit to users of low resolutiondisplays such as TV screens, to be able to watch regular and cable TVbroadcasts and to integrate with Internet content on demand. Inparticular, it would be desirable to provide such a user with a visualand legible indication when viewing a regular or TV broadcast ofavailable Internet movies or other programs and allow him to use thedisplayed indication to integrate with a desired Internet broadcast.

These requirements have been only partially addressed in the art WO00/08855 to United Video Properties, Inc. and entitled “A system andmethod for synchronising television-related product content andinternet-delivered information” describes a screen generator that mergesprogram guide data with a TV image and superimposes an Interactive TVGuide on the regular TV image.

US 2002/0093594 (Kikinis) entitled “Method and system for identifyingaddressing data within a television presentation” illustrates in FIG. 5the common connection of TV and Internet to a set-top box.

U.S. Pat. No. 6,606,746 to Opened, Inc. entitled “Interactive televisionsystem and method for displaying a graphical user interface using insertpictures” discloses interactive television having a compressedbackground picture and one or more compressed insert pictures commonlyconnected to a TV-Internet Integration box. The compressed insertpictures represent Items of a GUI. The local system i.e. computer“pastes” the insert pictures into the background image.

U.S. Pat. No. 6,130,898 to Bell Atlantic Network Services, Inc.,entitled “Simulcasting digital video programs for broadcast andinteractive services” teaches an interactive TV system where TVbroadcast data is merged with Internet data. To this end, publicwireless packet data network is combined with a broadband digitalbroadcast network at a plurality of transmitter sites. Customer premisesreceiving systems include a receiving antenna and one or more digitalentertainment terminals. The terminal includes a channel selector anddigital receiver for capturing a digital transport stream from aselected channel. A processor converts selected program information fromthe transport stream for presentation, e.g., via a television set. Theterminal also includes a CPU controlling the operation of the channelselector and the processor in response to user inputs.

None of these references appears to disclose the ability to mergebroadcast TV signals with IP packet data at a customer site,specifically in such a manner that a conventional TV set is able todisplay Internet program selection data while viewing a TV broadcastprogram and to use the selected data to select an Internet channel, suchas a movie, for display on the TV set instead of the TV broadcastprogram.

SUMMARY OF THE INVENTION

It is therefore an object of the present invention to provide aTV-Internet Integration Box having the ability to merge broadcast TVsignals with IP packet data at a customer site.

It is a further object that such a TV-Internet Integration Box permits aTV set connected thereto to display Internet program selection datawhile viewing a TV broadcast program and to use the selected data toselect an Internet movie for display instead of the TV broadcastprogram.

These objectives are realized in accordance with a first aspect of theinvention by a method for facilitating first data broadcast over a TVsubscriber channel to be displayed simultaneously together with seconddata broadcast over a digital data communications network, the methodcomprising:

receiving said first data and said second data;

combining said first data and said second data to form a combined videosignal; and

conveying said combined video signal to a TV set in a user premises fordisplaying a first image corresponding to the first data and havingsuperimposed thereon a second image corresponding to the second data,said second image being configured to allow a user at said user premisesto interact therewith for redirecting to the digital data communicationsnetwork and displaying a program broadcast thereby in at least a portionof the TV set.

In accordance with a second aspect of the invention there is provided amethod for facilitating first data broadcast over a TV subscriberchannel to be displayed simultaneously together with second databroadcast over a digital data communications network, the methodcomprising;

receiving said first data at a user premises;

receiving said second data at the user premises according to auser-profile associated with the second data;

combining said first data and said second data to form a combined videosignal; and

conveying said combined video signal to a TV set in a user premises fordisplaying a first image corresponding to the first data and havingsuperimposed thereon a second image corresponding to the second data,said second image being configured to allow a user at said user premisesto interact therewith for redirecting to the digital data communicationsnetwork and displaying a program broadcast thereby in at least a portionof the TV set.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to understand the invention and to see how it may be carriedout in practice, a preferred embodiment will now be described, by way ofnon-limiting example only, with reference to the accompanying drawings,is which:

FIG. 1 is pictorial representation showing a TV-Internet Integration Boxaccording to the invention connected to a mixed broadcast network forcombining Internet and broadcast TV signals;

FIG. 2 is a flow diagram showing the principal actions carried out bythe web server shown in FIG. 1;

FIG. 3 is a flow diagram showing the principal actions carried out bythe TV-Internet Integration Box shown is FIG. 1;

FIG. 4 is a flow diagram showing the principal actions carried out by anIP content provider such as an advertiser for creating IP content foroverlaying by the TV-Internet Integration Box with a broadcast TVsignal;

FIG. 5 is a block diagram showing the functionality of the TV-InternetIntegration Box shown in FIG. 1;

FIG. 6 is a block diagram showing the functionality of a remote controlunit for interfacing with the TV-Internet Integration Box shows in FIG.5;

FIGS. 7a, 7b and 7c are pictorial representations showing a TV setduring different stages of receiving and displaying combined Internetand broadcast TV signals; and

FIG. 8 is a flow diagram showing the principal actions earned out by theTV-Internet Integration Box when pre-fetching a digital broadcastsignal.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

FIG. 1 is pictorial representation showing a mixed broadcast network 10having a Cable TV Box 11 coupled to a satellite 12 and a Cable TVtransmitter 13 for receiving a cable TV broadcast signal (constitutingfirst data). An Internet broadcast signal comprising IP packet data(constituting second data) is streamed from a web server 14 via theInternet 15 (constituting a digital data communications network) to aTV-Internet Integration Box 16 for display on a TV set 17 coupledthereto. The TV set 17 may be constituted by a computer having a videocard and a high resolution display monitor. However, the principalbenefit of the invention is obtained when a regular TV set having lowresolution is used, since such a configuration has not so far been usedto integrate Internet programs with conventional TV broadcasts in themanner proposed by the invention. The TV-Internet Integration Box 16 isconnected to the Cable TV Box 11 for combining the broadcast TV signalsreceived by the Cable TV Box 11 with the IP packet date broadcast viathe Internet 15. Also shown is as advertiser 18 having a computercoupled to the Internet 15 for downloading advertising content to theweb server 14 for storage in a database 19 and a telephone 20 coupled tothe TV-Internet Integration Box 16 for feeding telephony signals to theTV-Internet Integration Box 16, which combines the received telephonysignals with video data received from the Cable TV Box 11 and/or theInternet 15.

The advertiser 18 typically pays for specific time slots and for one ormote specific channels during which his advertisement will be broadcast.Thus, in addition to the advertising content which is prepared and thenstored on the web server 14 in known manner, the advertiser 18 alsospecifies when the advertisement is to be broadcast and on which TVchannel or channels. By such means, a sports advertiser can request timeduring the interval of a football match to broadcast a commercial, whilea toy advertiser would obviously prefer to broadcast a commercial,during a children's TV program. Different time slots may be charged outat different rates depending on the ratings associated with theassociated TV program. After selecting one or more time slots, theadvertisement content as well as the selected time slots and programdata are stored in the database 19 accessed the web server 14.

FIG. 2 is a flow diagram showing the principal actions carried out bythe web server 14, which is responsive to an event timetable stored andupdated in the database 19. To this end, an IP content providerinterfaces with the web server for creating IP content and associatingtherewith calendar and program data indicating dates, times and channelsin respect of which the IP content is to be streamed to the customerpremises. Once this is done, the web server 14 monitors events, whichare triggered in known manner causing the web server 14 to extract fromthe database pre-stored ID content for streaming over the Internet 15 tothe TV-Internet Integration Box 16, where it is processed as describedbelow with reference to FIG. 3 of the drawings.

FIG. 3 is a flow diagram showing the principal actions carried out bythe TV-Internet Integration Box 16. In accordance with one embodiment ofthe invention, the subscriber selects what kind of IP content he wishesto receive and in respect of which program details, such as icons and/ortextual data, are to be displayed together with the TV broadcast data.For example, a subscriber may wish to block certain types of programmaterial or may wish to receives details thereof only during limitedhours, for example when the children are asleep. To this end, thesubscriber is able to program the TV-Internet Integration Box 16 in muchthe same way that a video cassette recorder is programmed so as to storein the memory 25 a timetable indicating what type of IP data is to bedisplayed and when. The timetable is updated as and when required by thesubscriber. The TV-Internet Integration Box 16 is adapted to check thetimetable periodically and to filter out incoming IP content that iseither of a type that is not required or that is broadcast during anunauthorized time window. By such means, an additional layer ofauthorization may be provided to that stored in the database 19 foraccess by the web server 14, thus allowing pre-fetching of IP contentand storage in the memory 25 of the TV-Internet Integration Box 16. Upondetecting a matching event, corresponding to received IP content that isof interest to the subscriber, the TV-Internet Integration Box 16overlays the matched IP content with the current broadcast and displaysthe new integrated video on the subscriber's TV set 17. For example, thematched information may be an icon that indicates to the subscriber thatan Internet movie is currently being broadcast; or it may be asadvertisement or information related to the TV program being broadcast.

The subscriber can respond to the overlaid data using a remote controlunit, described below with reference to FIG. 6 of the drawings, which isprogrammed to internet with the displayed icon or other data that isoverlaid on the TV broadcast. To this end, the displayed IP content mayoptionally contain textual information advising the subscriber to pressa particular button on the remote control unit. Alternatively, buttonson the remote control unit may be color-coded and the icon may becolored so as to indicate to the subscriber which color-coded button topress for selection of the corresponding IP content. If the subscriberresponds to the overlaid data by pressing a button on the remote controlunit, the TV-Internet Integration Box 16 receives the signal from theremote control unit and changes the priorities for use with thePicture-in-Picture (PIP) technique to display the TV broadcast in areduced window and to show the other media, i.e. the IP content, in anenlarged window. The IP content can be a custom designed web page forTV, or a game or advertisement movie or any other Information placed onthe matched record. PIP techniques are known per se and allow a video orgraphics image to be Inserted on top of a movie clip and to bepositioned and sized. An Effect In and Effect Out may be used to lade ormove the inserted video to the screen. In accordance with one suchtechnique, the bulk of the IP content e.g. corresponding to a movie maybe rendered transparent so as to provide a transparent window through,which an icon e.g. relating to the movie is visible. The video contentof the TV broadcast is displayed in one window and the IP content inanother window. Since the bulk of the IP content is transparent it willremain invisible to the subscriber, while the icon (or text) will, bevisible since it is opaque. On selecting the displayed icon, theattributes may simply be reversed so as to hide the icon whiledisplaying the movie or other content. At the same time, the TVbroadcast may be re-sized either to display it in a minimized window itthe case that it is to be suppressed altogether, or to display itsuperimposed on the IP content so that both are visible at the same timein different, possibly overlapping, windows.

FIG. 4 is a flow diagram showing the principal actions carried out by anIP content provider such as an advertiser for creating IP content foroverlaying by the TV-Internet Integration Box with a broadcast TVsignal. Thus, the advertiser designs an advertisement and sends ittogether with a request to a web sits link via the Internet or off-lineas required. Since the IP content is intended for display on a lowresolution TV screen, any textual information that forms part of the IPcontent is formatted so as to be legible when displayed on lowerresolution TV screens. Generally, this requires reducing the quantity oftextual information to a minimum and sizing any text so that it islegible. Often, a web advertiser will wish to create an on-lineadvertisement based on an existing web page. In such case, it may benecessary to reduce and resize any textual information so as to complywith these requirements.

The request specifies calendar and program data as explained above,which the web site operator checks for availability and type, definingto which group of users it belongs. If the required time slots areavailable for the requested channels, the site operator confirms therequest and forwards the request to the web control room for finalconfirmation. On confirming the request, a status flag of theadvertisement is changed so as to indicate that the advertisement isawaiting final confirmation from the web control room. At the webcontrol room the advertisement is checked for content by humanevaluators who either approve or reject the advertisement content and,in the case of rejection, may provide reasons therefore. If theadvertisement (or other IP content) is approved by the web controlcenter, its status is set to “approved” and the web control center billsthe customer and the web site operator adds the advertisement and thescheduling information to the database 19. The customer who is billed istypically the advertiser but may be any entity that is identified by adigital signature associated with the advertisement If either of therequests for approval is rejected the status of the advertisement is setto “rejected” and the web control room informs the advertiser of thegrounds for rejection, allowing the advertiser to change the request andre-send to the web site operator. Optionally, in such case the webserver may be adapted to display to the advertiser the occupiedtimetable and suggest new timetable. Only those advertisements whosestatus flag indicates that they are approved by the web control room areactually available for transmission. The time slot and channelinformation associated with any advertisement that is not so approvedremain available for other advertisements and will be shown as availableto another advertiser who attempts to schedule an advertisement. Onlywhen the advertisement is actually approved by the web site operator andits status is updated accordingly, are the transmission time and channellooked for use by other users.

The IP packet data may optionally be associated with predefineduser-profiles that are also stored in the database 19 so that theadvertisement or other IP data is sent only to specific TV-InternetIntegration Boxes. Such user-profiles may be configured by theadvertiser or by the user. Thus, for example, the invention allowssupplementary or complementary program content to be associated with aTV broadcast, while providing the facility to view the supplementaryprogram content only to specific subscribers, according to theiruser-profiles.

Thus, by way of non-limiting example, the invention allows sign languageto be associated with a TV broadcast for the hard of hearing. It isknown to display sign language in a corner of the screen, but since thisis usually done indiscriminately it also apt to disturb the majority ofviewers who do not need the sign language. The invention may be used toavoid this by conveying the sign language as IP content separate frommain TV broadcast and allowing subscribers to register for a “signlanguage” service so that only registered subscribers receive the IPcontent. IP content files corresponding to sign language to beassociated with different TV broadcasts are created as explained above,and stored, in the database 19 together with user-profile dataindicating which subscribers are registered to obtain the service. Theuser-profile data may contain data that further refines the targetaudience, such as categories of TV program alongside which the signlanguage is to be displayed. The user-profile data may further containgeographical data or language data that allows sign languagecorresponding to a target language to be conveyed to specific audiences.By such means, a TV program can be accompanied by a sign languageoverlay that is customized to a target language depending on thelocation of the IP target address or the language requested by thesubscriber on registering for the service.

FIG. 5 is a block diagram showing the functionality of the TV-InternetIntegration Box 16 shown in FIG. 1. Thus, the TV-Internet IntegrationBox 16 comprises a first input 21 for receiving first data correspondingto TV broadcast signal, typically being a cable TV signal and a secondinput 22 for receiving respective second data corresponding to IP packetdata. The IP packet data may optionally be downloaded to specificTV-Internet Integration Boxes m accordance with predefined user-profilesassociated with IP packet data and stored in the database 19. A combinerunit 23 is coupled to the first and second inputs for combining thefirst data and the second data to form a combined video signal. A videooutput 24 is coupled to the combiner unit 23 for conveying the combinedvideo signal to a TV set in a user premises. The TV set may be aconventional TV having a relatively low resolution screen for displayinga first image corresponding to the first data and having superimposedthereon a second image corresponding to the second data. Alternatively,it can be a computer having a video card for displaying a combined videoimage on a high resolution display monitor.

The combiner unit 23 is shown coupled to a processing unit 25 althoughin practice it may be implemented in software by the processing unit 25.A memory 25 is coupled to the processing unit 25 for storing programdata, such as profiles and program timetables etc, so as to allow theprocessing unit 25 to filter incoming IP content according topre-defined profiles and other selection data. The processing unit 25 isalso coupled to a user interface 27 that allows the subscriber toprogram the TV-Internet Integration Box 16 and store the program data inthe memory 26. An IP receiver 28 is adapted to receive IR commands froma remote control unit described below with reference to FIG. 6 and iscoupled to a decoder 29, which decodes a received IR signal and feeds itto the processing unit 25 for further processing.

FIG. 6 is a block diagram showing the functionality of a remote controlunit 30 for interfacing with the TV-Internet Integration Box 16 shown inFIG. 5. The remote control unit 30 includes a processing unit 31 coupledto a user interface 32, typically having a keypad or pushbuttons forprogram selection and setting as well as other functions. The userinterface 32 is coupled to an encoder 33 which is responsive to apressed key or key combination for producing a corresponding IR signalthat is transmitted by an IR transmitter 34 to the TV-InternetIntegration Box 16 for receipt by the IR receiver 28 thereof.

As noted above, the keys may be color coded in correspondence withpre-arranged colors of commonly displayed icons, so that pressing on aspecific key activates the displayed icon of the same color.Alternatively, at least some of the keys may be covered with transfersdepicting commonly displayed icons, whereupon the appropriate keys orbutton for activating each icon are easily recognized.

The keys may also be programmed so that depressing the same key morethan once automatically re-sizes the windows containing the TV broadcastand the Internet broadcast. For example, FIG. 7a shows the defaultsituation where a TV screen 40 displays a conventional TV broadcast in awindow 41 that is sized to occupy the whole area of the TV screen 40 andwill be referred to as the primary window. Also shown are IP icons 42,43 and 44 each of which points to a different IP content that isstreamed from a respective web site of known address. On pressing thekey on the remote control unit 30 that corresponds to the icon 42, theIP content corresponding thereto is displayed within a small window 45(referred to as the secondary window) that is contained within theprimary window 41 as shown in FIG. 7d . The icons 42, 43 and 44 remainvisible so that, if desired, the selected program can be changed bypressing a different key on the remote control unit 30. On pressing akey a second time in succession, the IP content is re-sized so that itswindow 45 occupies substantially the whole area of the screen as shownin FIG. 7c . On pressing the key a third time in succession, thesituation reverts to the default shown in FIG. 7a where the primarywindow 41 containing the TV broadcast occupies the whole area of the TVscreen 40. Thus, each key operates as a three-way toggle that switchesbetween three different display modes.

The second data containing display information for the icons alsocontains data that informs the TV-Internet Integration Box 16 on whichchannel or channels the associated IR content is to be streamed and atwhat times. The second data also specifies the web site where the IPcontent is located. This is summarized in the following table:

TABLE I Second data - definition Icon image Channel Time Website of IPcontent ICON.GIF 2; 23 19:30; 21:30 www.AB.com/adverts/123.htm

Thus, the second data depicted in Table I above shows that the iconimage is contained in a file called ICON.GIF and that the IP contentrelating thereto is to be streamed on channels 2 and 23 at times 19:30and 21:30, these being the start times. The end times are determined bythe duration of the IP content to be streamed, which is downloaded froma web site whose name is shown in the table and is contained in thesecond data.

The second data is downloaded from the web server 14 whose web siteaddress is known to the TV-Internet Integration Box 16. In accordancewith one embodiment, the processing unit 25 is programmed to access theweb server 14 periodically and download current program data. Forexample, once every 2 to 3 hours the TV-Internet Integration Box 16 mayautomatically access the web server 14 to download the second datacorresponding current program data for the next 3 hours as formattedaccording to Table I. The downloaded information is stored locally inthe memory 26 of the TV-Internet Integration Box 16. This allows theTV-Internet Integration Box 16 to pre-fetch IP content relating to allthe currently displayed icons and to store the data relating thereto inthe memory 26 thus obviating the need to access the web site of aselected icon for the purpose of downloading IP selected content. Sincethis carries the overhead of web access and downloading of data, whichcan be cumbersome particularly if there is insufficient bandwidth,pre-fetching in this manner ensures that initial IP content data will beimmediately available on selection of one of the icons.

FIG. 8 is a flow diagram, showing the principal actions carried out bythe TV-Internet Integration Box when pre-fetching a digital broadcastsignal. Thus, the TV-Internet Integration Box 16 periodically accessesthe web server 14 and downloads current program data, constituting thesecond data. It then extracts from the current program data the imagefiles of the current icons and stores them in the memory 26. In likemanner, if extracts the web sites of the IP content corresponding to thecurrently displayed icons and then accesses these sites to pre-fetch therespective IP content, which it likewise stores in the memory 26. Onselection of an icon, the TV-Internet Integration Box 16 opens asecondary window 45 within the primary window 41, reads from the memory26 the prefetched IP content and displays it in the secondary window 45.

It will be understood that the TV-Internet Integration Box according tothe invention may be at least partially implemented by a suitablyprogrammed computer. Likewise, the invention contemplates a computerprogram being readable by a computer for executing the method of theinvention. The invention further contemplates a machine-readable memorytangibly embodying a program of instructions executable by the machinefor executing the method of the invention.

15. A TV-Internet Integration process to combine, at a user's premises, TV channel video with Internet Protocol (IP) material, comprising: receiving the TV channel video at a first input at the user's premises, receiving the IP material at a second input at the user's premises, and outputting display drive signals to a TV screen at the user's premises; wherein (i) as received at the user's premises, the TV channel video conforms to a TV broadcast format standard; (ii) as received at the user's premises, the IP format material conforms to an IP format standard that is different from the TV broadcast format standard and (iii) the IP material is received via a path different from that for the TV channel video at least in part; storing, in a memory, one or more overlays each identifying a respective source of IP format material; selectively generating display drive signals that cause the TV screen to display the TV channel video received at the first input; responding to an overlay activation signal by reading out the one or more overlays from the memory and generating display drive signals that cause the TV screen to display the one or more overlays; and responding to a user's selection of one of the displayed overlays by generating display drive signals that cause the TV screen to display the IP material associated with the selected overlay and received at the second input; wherein, depending on the user's selection at the user's premises, the TV screen displays, at respective times, the TV channel video received at the first input, the one or more overlays, and the IP material associated with the selected overlay and received at the second input.
 16. The TV-Internet Integration process of claim 15 in which the display drive signals that cause the TV screen to display the one or more overlays cause the screen to display the one or more overlays over a concurrent display of the TV channel video on the screen.
 17. The TV-Internet Integration process of claim 15 in which the display drive signal that cause the TV screen to display the one or more overlays cause the screen to display the one or more overlays in respective windows on the TV screen while the screen is displaying the TV channel video.
 18. The TV-Internet Integration process of claim 15 in which the overlay activation signal is generated as a function of testing if specified conditions at the user's premises match contents of the memory.
 19. The TV-Internet Integration process of claim 15 including pre-fetching one or more overlays and storing the one or more pre-fetched overlays in a memory at the user's premises for subsequent display on the TV screen.
 20. The TV-Internet Integration process of claim 15 including pre-fetching IP material and storing the pre-fetched IP material in a memory at the user's premises for subsequent display on the TV screen.
 21. The TV-Internet Integration process of claim 15 including providing a set top box decoding TV channel video and supplying the resulting decoded TV channel video to said first input.
 22. The TV-Internet Integration process of claim 21 in which the IP material path bypasses the set top box.
 23. The TV-Internet Integration process of claim 15 in which the TV screen displays at least one of the one or more overlays in response to a special overlay activation signal from an external source timed relative to an event in the TV channel video displayed on the TV screen.
 24. The TV-Internet Integration process of claim 15 in which the TV screen displays one or more overlays that point to sources of IP material but not to specific IP material.
 25. The TV-Internet Integration process of claim 15 including selectively processing, at the user's premises, an overlay activation signal per input from the user. 